An MEG signature corresponding to an axiomatic model of reward prediction error

نویسندگان

  • Deborah Talmi
  • Lluis Fuentemilla
  • Vladimir Litvak
  • Emrah Düzel
  • Raymond J. Dolan
چکیده

Optimal decision-making is guided by evaluating the outcomes of previous decisions. Prediction errors are theoretical teaching signals which integrate two features of an outcome: its inherent value and prior expectation of its occurrence. To uncover the magnetic signature of prediction errors in the human brain we acquired magnetoencephalographic (MEG) data while participants performed a gambling task. Our primary objective was to use formal criteria, based upon an axiomatic model (Caplin and Dean, 2008a), to determine the presence and timing profile of MEG signals that express prediction errors. We report analyses at the sensor level, implemented in SPM8, time locked to outcome onset. We identified, for the first time, a MEG signature of prediction error, which emerged approximately 320 ms after an outcome and expressed as an interaction between outcome valence and probability. This signal followed earlier, separate signals for outcome valence and probability, which emerged approximately 200 ms after an outcome. Strikingly, the time course of the prediction error signal, as well as the early valence signal, resembled the Feedback-Related Negativity (FRN). In simultaneously acquired EEG data we obtained a robust FRN, but the win and loss signals that comprised this difference wave did not comply with the axiomatic model. Our findings motivate an explicit examination of the critical issue of timing embodied in computational models of prediction errors as seen in human electrophysiological data.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Combined MEG and fMRI model

An integrated model for magnetoencephalography (MEG) and functional Magnetic Resonance Imaging (fMRI) is proposed. In the proposed model, MEG and fMRI outputs are related to the corresponding aspects of neural activities in a voxel. Post synaptic potentials (PSPs) and action potentials (APs) are two main signals generated by neural activities. In the model, both of MEG and fMRI are related to t...

متن کامل

Testing the reward prediction error hypothesis with an axiomatic model.

Neuroimaging studies typically identify neural activity correlated with the predictions of highly parameterized models, like the many reward prediction error (RPE) models used to study reinforcement learning. Identified brain areas might encode RPEs or, alternatively, only have activity correlated with RPE model predictions. Here, we use an alternate axiomatic approach rooted in economic theory...

متن کامل

Dopamine, Reward Prediction Error, and Economics∗

The neurotransmitter dopamine has been found to play a crucial role in choice, learning and belief formation. The best developed current theory of dopaminergic function is the “reward prediction error” hypothesis that dopamine encodes the difference between the experienced and predicted “reward” of an event. We provide axiomatic foundations for this hypothesis to help bridge the current concept...

متن کامل

Magneto- and electroencephalographic manifestations of reward anticipation and delivery

The monetary incentive delay task was used to characterize reward anticipation and delivery with concurrently acquired evoked magnetic fields, EEG potentials and EEG/MEG oscillatory responses, obtaining a precise portrayal of their spatiotemporal evolution. In the anticipation phase, differential activity was most prominent over midline electrodes and parieto-occipital sensors. Differences betw...

متن کامل

Finite Element Simulation and ANFIS Prediction of Dimensional Error Effect on distribution of BPP/GDL Contact Pressure in PEM Fuel Cell

Distribution of contact pressure between the bipolar plate and gas diffusion layer considerably affect the performance of proton exchange membrane fuel cell. In this regard, an adaptive neuro-fuzzy inference system (ANFIS) is developed to predict the contact pressure distribution on the gas diffusion layer due to dimensional errors of the bipolar plate ribs in a proton exchange membrane fuel ce...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره 59  شماره 

صفحات  -

تاریخ انتشار 2012